Machine-readable form configuration and system and method for interpreting at least one user mark

ABSTRACT

One embodiment of the present invention relates to a machine-readable form configuration (and associated method). Another embodiment of the present invention relates to a system for interpreting at least one user mark (and associated methods). In one example, a plurality of user marks may be interpreted. In another example, the machine-readable form may be a lottery play slip, survey, test, or the like. In another example, the system may interpret user mark(s) made on a lottery play slip, survey, test or the like. In another example, the system may interpret user mark(s) made on a paper or the like having non-planar distortion(s).

RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional Application Ser.No. 61/086,180, filed Aug. 5, 2008 and Greek Application Ser. No.20080100525, filed Aug. 4, 2008, each of which is incorporated herein byreference in its entirety.

FIELD OF THE INVENTION

One embodiment of the present invention relates to a machine-readableform configuration (and associated method).

Another embodiment of the present invention relates to a system forinterpreting at least one user mark (and associated methods).

In one example, a plurality of user marks may be interpreted.

In another example, the machine-readable form may be a lottery playslip, survey, test, or the like.

In another example, the system may interpret user mark(s) made on alottery play slip, survey, test or the like.

In another example, the system may interpret user mark(s) made on apaper or the like having non-planar distortion(s).

For the purposes of describing and claiming the present invention, theterm “lottery play slip” is intended to refer to the form upon which auser places marks to indicate desired selection(s).

Further, for the purposes of describing and claiming the presentinvention, the term “lottery ticket” is intended to refer to a receiptindicating the selection(s) made by a user.

Further, for the purposes of describing and claiming the presentinvention, the term “fiducial mark” is intended to refer to a markdefining a datum point or standard of positional reference used as abasis for calculation or measurement.

Further, for the purposes of describing and claiming the presentinvention, the term “user marking cell” is intended to refer to an areaon a form intended to receive an indication of a desired selection by auser.

Further, for the purposes of describing and claiming the presentinvention, the term “scale invariant” is intended to refer to having oneor more characteristics that will not change under different scales (ordistances).

Further, for the purposes of describing and claiming the presentinvention, the term “image sensor” is intended to refer to that part ofa camera which converts an optical image into an electrical signal.

Further, for the purposes of describing and claiming the presentinvention, the term “interpreting user marks” is intended to refer toidentifying at least the presence and position of user marks.

Further, for the purposes of describing and claiming the presentinvention, the term “planar position” is intended to refer to theprojection onto the image of the position of the center of an element ofthe form (e.g. fiducial mark, user marking cell), under the assumptionthat the form is planar.

BACKGROUND OF THE INVENTION

Forms intended for lottery games, surveys and the like havetraditionally been read by page scanners, whose mechanical feedingmechanism also flattened the form with the help of rollers and springsbefore presenting the form to the scanning head. Subsequently, scanningwas performed under controlled lighting conditions that disregard a setof colors, termed “blind colors” (e.g., red and its close hues). All theregions that are intended for user markings as well as any informationnot required to be machine-readable have typically been colored in theseblind colors, so that there has been adequate guidance for the user'splacement of marks, but the guides themselves remained essentiallyinvisible to the scanning sensor. This eased the user mark detectionprocess. Additional machine-readable indices may have been printed inmachine-visible ink along a side of the form, separate from the areaallocated to user markings, to help the inference of the possiblemarking areas (typically arranged in the form of a rectangular grid) bythe machine. These machine-readable markings would traditionally allowcompensation for the image shift and/or rotation encountered during thescanning process, but would not traditionally convey any other spatialinformation (e.g., scaling and/or position in the 3D space).

The traditional page scanner has complex and precise mechanical parts;hence its dimensions are typically dictated by the document size andmechanical complexity, increasing its overall size and manufacturingcosts. Additionally, regular maintenance is typically needed, furtherincreasing the ownership cost.

At least in part for these reasons, image sensors have been proposed forthe task. Of note, image sensors have been known to be used in the artfor reading barcode symbols, but these bar code applications operateunder strict printing tolerances for machine printing and offerdesigned-in redundancy that facilitates reading by such a sensor.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1-3 show systems according to various embodiments of the presentinvention.

FIG. 4 shows detail of a lottery play slip 400 according to anembodiment of the present invention (attention is directed in particularto fiducial marks 401A and 401B).

FIG. 5 shows detail of a conventional lottery play slip 500 (attentionis directed in particular to conventional fiducial marks 501A and 501B).

FIG. 6 shows a view of a larger portion of lottery play slips 400 and500 (of FIGS. 4 and 5, respectively).

FIG. 7 shows a view of a large portion of lottery play slips 700A and700B (lottery play slip 700A incorporates various embodiments of thepresent invention such as fiducial marks 701A,701B and user markingcalls bounded by a non-blind color while lottery play slip 700B is of aconventional type).

FIG. 8 shows detail of a lottery play slip 800 according to anembodiment of the present invention (attention is directed in particularto the grid of user marking cells bounded by a non-blind color).

FIG. 9 shows detail of a conventional lottery play slip 900 (attentionis directed in particular to the grid of user marking cells bounded by ablind color).

FIG. 10 shows a view of a portion of lottery play slips 1000A and 1000B(lottery play slip 1000A incorporates various embodiments of the presentinvention such as user marking cells bounded by a non-blind color).

FIG. 11 shows a view of a portion of conventional lottery play slip 1100(attention is directed in particular to conventional fiducial marks1101A and 1101B and attention is directed in particular to the grid ofuser marking calls bounded by a blind color).

FIG. 12 shows a view of a number of conventional lottery play slips1200A-1200D (attention is directed in particular to conventionalfiducial marks, attention is directed in particular to the grid of usermarking calls bounded by a blind color, and attention is directed to the“clocks” (that is, the markings along one or more sides of the forms).

FIGS. 13A and 13B show a flowchart providing additional detail regardinga detection/determination method according to an embodiment of thepresent invention (of course, as seen, the flow continues from (A) atthe bottom of FIG. 13A to (A) at the top of FIG. 13B).

Among those benefits and improvements that have been disclosed, otherobjects and advantages of this invention will become apparent from thefollowing description taken in conjunction with the accompanyingfigures. The figures constitute a part of this specification and includeillustrative embodiments of the present invention and illustrate variousobjects and features thereof.

DETAILED DESCRIPTION OF THE INVENTION

Detailed embodiments of the present invention are disclosed herein;however, it is to be understood that the disclosed embodiments aremerely illustrative of the invention that may be embodied in variousforms. In addition, each of the examples given in connection with thevarious embodiments of the invention is intended to be illustrative, andnot restrictive. Further, the figures are not necessarily to scale, somefeatures may be exaggerated to show details of particular components(and any size, material and similar details shown in the figures are, ofcourse, intended to be illustrative and not restrictive). Therefore,specific structural and functional details disclosed herein are not tobe interpreted as limiting, but merely as a representative basis forteaching one skilled in the art to variously employ the presentinvention.

As described herein, various embodiments of the present inventionprovide systems with image sensors for reading human-marked forms. Oneor more of such embodiments may reduce or eliminate certain limitationstraditionally encountered with conventional image sensors regarding formplacement, ambient illumination and/or form flatness.

Further, as described herein, various embodiments of the presentinvention provide a configuration (e.g., a design) for printed formsintended for users to put handwritten marks such that the forms aresuitable for scanning by a single camera. In one example, reliable markinterpretation may achieved no matter the flatness of the form (in thisexample, as long as the user marks are not obstructed from the camera,the form can be curved, folded or even crumbled).

Further, as described herein, various embodiments of the presentinvention provide a system which utilizes a form configuration thatovercomes the distortions introduced by out-of-plane distortions of theform, therefore allowing the interpretation of the form markings from asingle image sensor that can take a full image of the form.

One embodiment of the present invention provides a form, comprising: atleast one user marking cell and at least one fiducial mark; wherein thefiducial mark has a measurable property that is essentiallyscale-invariant (for example, as described in more detail below, such ameasurable property may comprise a ratio of an area of the fiducial markover an area of an interior or “hollow” portion of the fiducial mark).

In one example, the form may be selected from the group consisting of: alottery play slip; a survey; and a test.

In another example, the form may comprise a plurality of user markingcells.

In another example, the fiducial mark may comprise a hollow outlineprinted in a color visible to the image sensor (e.g., wherein the ratioof the area of the mark (that is, the area encompassed by the outline(inclusive of the outline)) over the area of the fiducial mark'sinterior portion (that is, hollow portion) is predetermined).

In another example, the fiducial mark may comprise an outline printed ina color visible to the image sensor and an interior portion printed in acolor that is essentially not visible to the image sensor (e.g., whereinthe fiducial mark thus appears hollow to the image senor and wherein theratio of the area of the mark that is, the area encompassed by theoutline (inclusive of the outline)) over the area of the fiducial mark'sinterior portion (that is, hollow portion) is predetermined).

In another example, the fiducial mark may comprise an outline printed ina color visible to the image sensor and an interior portion printed in acolor that is also visible to the image sensor, wherein there issufficient contrast (and/or other distinguishing feature(s)) between theoutline and the interior portion for the image sensor to distinguishbetween the outline and the interior portion (e.g., wherein the ratio ofthe area of the mark (that is, the area encompassed by the outline(inclusive of the outline)) over the area of the fiducial mark'sinterior portion (that is, hollow portion) is predetermined).

In another example, the fiducial mark may be of a shape that providesorientation information (e.g., an isosceles triangle, a trapezoid, ashape shown in FIG. 4 as 401A or 401B).

In another example, the fiducial mark may provide a mechanism via whicha distance of the image sensor from the portion of the form upon whichthe fiducial mark is printed may be determined (e.g., calculated).

In another example, a plurality of fiducial marks may be provided.

In another example, one or more user marking cells (e.g., the outline ofsuch cells) may be printed in a color that is visible to the imagesensor.

In another example, indicia may be disposed within one or more usermarking cells.

In another example, the indicia may comprise numbers and/or letters.

Another embodiment of the present invention provides a system forinterpreting at least one user mark on a form, comprising: an imagesensor; and a programmed processor in operative communication with theimage sensor; wherein the image sensor and the programmed processor areconfigured to: (a) calculate a distance between at least a firstfiducial mark on the form and a second fiducial mark on the form,wherein the first and second fiducial marks each have a measurableproperty that is essentially scale-invariant; and (b) interpret at leastone user mark in at least one user marking cell on the form based atleast in part upon the calculated distance.

In another example, the system may calculate a distance between theimage sensor and at least one fiducial mark on the form, wherein thefiducial mark has a measurable property that is essentiallyscale-invariant.

Another embodiment of the present invention provides a method forinterpreting at least one user mark on a form, comprising: (a)calculating a distance between at least a first fiducial mark on theform and a second fiducial mark on the form, wherein the first andsecond fiducial marks each have a measurable property that isessentially scale-invariant; and (b) interpreting at least one user markin at least one user marking cell on the form based at least in partupon the calculated distance.

In another example, the method may calculate a distance between theimage sensor and at least one fiducial mark on the form, wherein thefiducial mark has a measurable property that is essentiallyscale-invariant.

Another embodiment of the present invention provides a form, comprising:at least one user marking cell, wherein the user marking cell is in acolor that is visible to the image sensor.

In one example, the form may be selected from the group consisting of: alottery play slip; a survey; and a test.

In another example, the form may comprise a plurality of user markingcells, wherein the plurality of user marking cells is in a color that isvisible to the image sensor

In another example, the form may further comprise at least one fiducialmark; wherein the fiducial mark has a measurable property that isessentially scale-invariant (for example, as described in more detailbelow, such a measurable property may comprise a ratio of an area of thefiducial mark over an area of an interior or “hollow” portion of thefiducial mark).

In another example, the fiducial mark may comprise a hollow outlineprinted in a color visible to the image sensor (e.g., wherein the ratioof the area of the mark (that is, the area encompassed by the outline(inclusive of the outline)) over the area of the fiducial mark'sinterior portion (that is, hollow portion) is predetermined).

In another example, the fiducial mark may comprise an outline printed ina color visible to the image sensor and an interior portion printed in acolor that is essentially not visible to the image sensor (e.g., whereinthe fiducial mark thus appears hollow to the image senor and wherein theratio of the area of the mark that is, the area encompassed by theoutline (inclusive of the outline)) over the area of the fiducial mark'sinterior portion (that is, hollow portion) is predetermined).

In another example, the fiducial mark may comprise an outline printed ina color visible to the image sensor and an interior portion printed in acolor that is also visible to the image sensor, wherein there issufficient contrast (and/or other distinguishing feature(s)) between theoutline and the interior portion for the image sensor to distinguishbetween the outline and the interior portion (e.g., wherein the ratio ofthe area of the mark (that is, the area encompassed by the outline(inclusive of the outline)) over the area of the fiducial mark'sinterior portion (that is, hollow portion) is predetermined).

In another example, the fiducial mark may be of a shape that providesorientation information (e.g., an isosceles triangle, a trapezoid, ashape shown in FIG. 4 as 401A or 401B).

In another example, the fiducial mark may provide a mechanism via whicha distance of the image sensor from the portion of the form upon whichthe fiducial mark is printed may be determined (e.g., calculated).

In another example, a plurality of fiducial marks may be provided.

In another example, one or more user marking cells (e.g., the outline ofsuch cells) may be printed in a color that is visible to the imagesensor.

In another example, indicia may be disposed within one or more usermarking cells.

In another example, the indicia may comprise numbers and/or letters.

Another embodiment of the present invention provides a system forinterpreting at least one user mark on a form, comprising: an imagesensor and a programmed processor in operative communication with theimage sensor; wherein the image sensor and the programmed processor areconfigured to interpret at least one user mark in at least one usermarking cell based at least in part upon at least one user marking cellthat is in a color that is visible to the image sensor.

Another embodiment of the present invention provides a method forinterpreting at least one user mark on a form, comprising: interpretingat least one user mark in at least one user marking cell based at leastin part upon at least one user marking cell that is in a color that isvisible to an image sensor.

Another embodiment of the present invention provides detected usermarking cells that are associated to the ideally planar user markingcells on the form by comparing the detected locations of the centers ofthe detected user marking cells with the ideally planar locations of theuser marking cells.

In one example, the association is done in a circular manner around thefiducials, progressing from their nearest detected user marking cell, totheir most distant (this may be done to take advantage of the knownscale in the vicinity of the fiducials). The first center of the nearestdetected user marking cell in this example is associated to its nearestideally planar location of the user marking cell if their separation issmaller than a predetermined amount. In this example, a displacementvector between the associated planar and detected location iscalculated. Any consecutive center of the detected user marking cells inthis example is first displaced by the amount indicated by thedisplacement vector of its nearest associated neighbor. The displacedcenter in this example is then associated to its nearest ideally planarlocation of the user marking cells if their distance is smaller than apredetermined amount. In this example, the process is repeated for allplanar locations of possible user marking cells. Any non-associatedplanar positions in this example have their displacement vectorsinterpolated from their associated neighbors.

Of note, all feature(s) of the invention disclosed, for example, in thecontext of the figures or detailed description, may be separatelycombinable with any other feature(s) of the invention unless immediatelyapparent from the context.

Referring now to FIG. 1, a system 101 according to one embodiment of thepresent invention comprises a form resting surface 103, above which animage sensor (e.g., a monochrome image sensor) is positioned (the sensoris inside housing 105). In one example, the sensor may have its opticalaxis offset from the perpendicular to the resting surface 103 by a fewdegrees. The resting surface 103 may be recessed, bounded or otherwiseinclude barriers or guides so that the forms are placed completelywithin. One barrier 107 is shown in this FIG. 1; FIG. 2 shows anotherembodiment with two barriers 207A, 207B. The image sensor may beequipped with a suitable lens, capable of providing images of theform(s) placed on the form resting surface 103 and so designed andaligned, for example, that the image sensor captures images of the fullextent of the resting surface 103 and any forms residing on it. Anoptical filter may be placed in the optical path, for example, in front,behind or inside the lens, so that hues of some specific color (forexample red) and its closely matching colors are rendered essentiallyinvisible to the image sensor. In another example, one or more lightsources (e.g., Light Emitting Diodes (LEDs) and/or other light sources)may be utilized to provide illumination in cases where the ambientillumination is not sufficient to render the images on the image sensor(the light source(s) may be placed inside housing 105, for example).

On the form resting surface an a-priori determined pattern of machinevisible marks with known dimensions and relative locations maypermanently be located (imprinted or otherwise), for example a set ofsmall squares (see, e.g., marks 301A-301D of FIG. 3) These marks may be“initialization” datum to allow, for example, for estimation of theimage sensor position with respect to the forms resting surface and forthe compensation of the projective transformation distortions due to therelative placement of the form resting surface and the sensor in 3Dspace.

In operation, the system may monitor the form resting surface for theexistence of stationary forms (e.g., after a form is moved into view andleft by a user). Upon detection of such a situation, a high-resolutionimage may be captured and processed to extract the user marks (e.g.,from a single form which is placed on the resting surface or from thetopmost form in a stack of forms). This may be done by detecting theform of interest in the image, extracting printed and user marks in itand associating user marks with specific cells intended for marking.

Reference will now be made to form curvature, folding and/or crumbling,resulting in non-planar distortions. When such distorted forms areimaged by the image sensor, the distortions typically result in localprojective transformations that do not preserve the global scale andorientation (as these may be estimated, for example, from the formresting surface marks and the machine-readable markings on the form). Asa result, under these conditions the exact position of the user cellsmay not be inferred adequately from the machine readable markings alongone or more edges of the form.

To aid in interpretation of the user marks on such a non-planar form, aform according to an embodiment of the present invention may carrythereon:

1. A plurality of scale-invariant machine-printed marks (termed“fiducial marks”) for the detection of the form; and

2. Non-blind color border on each of the cells intended for user marking

Reference will now be made to an embodiment of certain machine-readablemarkings, that is, fiducial marks.

The detection may be performed by checking for valid groups of printedfiducial marks that all need to be present in the image if the formunder question is the topmost one in the stack. In one example, a numberof predetermined machine-readable fiducial marks are printed on theform, and such fiducial marks may be used to estimate the relative shiftand rotation of the form, as well as any scale difference (e.g., causedby stacking multiple (and possibly non-planar forms) and hence reducingthe distance of the topmost (and/or non-planar) form from the camera).Location of these machine-readable fiducial marks relative to the usermarking cells must, in one example, be known a priori—but their absolutelocation on the form is not critical. The design of the machine-readablefiducial marks may be made specifically so that the shape of themachine-readable fiducial mark conveys information of scale andorientation of the mark (and consequently of the form it is carriedupon) with respect to the image sensor. Special care may be given in thedesign of the machine readable fiducial marks to make sure that theyhave a measurable property that is scale-invariant (typically, undernon-planar form distortions, size information is lost and shapes aredistorted). To be able to detect the fiducial marks under thesecircumstances, the fiducial marks (see, e.g., 401A, 401B of FIGS. 4 and6 and 701A, 701B of FIG. 7) may be designed as hollow objects, e.g.,where the ratio of the area of the mark (that is, the area encompassedby the outline (inclusive)) over the area of the fiducial mark'sinterior (or hollow) portion is predetermined. In one example, thehollow objects may comprise an outline only; in another example, thehollow objects may comprise a machine readable outline with the interiorprinted in a blind color (in contrast to such hollow objects, see, e.g.,traditional fiducial marks 501A, 501B (essentially solid squares) ofFIGS. 5 and 6, and traditional fiducial marks 1100A, 11001B (essentiallysolid squares) of FIG. 11). Since this ratio of the area of the markover the area of the mark's hollow is invariant to scale changes, suchconfiguration may allow for the detection of the fiducial marks at anydistance from the camera (in order to determine distance from thecamera).

Reference will now be made to the user area form design. As hastraditionally been done, several small cells are provided for the usersto mark with any mark they desire (the cells may be laid, for example,in a typical uniform rectangular grid pattern). In the past, the usermarking cells have been printed in a machine-invisible color in order toreduce the detection burden for the machine (see, e.g., lottery playslip 700B of FIG. 7, lottery play slip 900 of FIG. 9, lottery play slip1000B of FIG. 10, lottery play slip 1100 of FIG. 11 and lottery playslips 1200A-1200D of FIG. 12). In contrast, under various embodiments ofthe present invention, the cells where users can place marks may havetheir outline printed in some non-blind color, thus making eachindividual cell visible to the machine (see, e.g., lottery play slip 800of FIG. 8. and lottery play slip 1000A of FIG. 10). This aids in thedetection of each user marking cell under non-planar distortion. Ofcourse, due to the non-planar distortion, the detected user markingcells are no longer arranged on the grid originally designed for theform, i.e. the expected cell locations. To correctly interpret the usermarks, the detected cells need to be associated to the expected celllocations. This may be done, for example, by starting from the usermarking cells closest to the fiducial marks. Upon association to anexpected cell location, a displacement vector may be obtained for thedetected cell. Adjacent user marking cells may be subsequently detectedusing the displacement of their neighbors as reference, the processbeing repeated to gradually reveal the complete pattern of the celllayout of the form on the image picture elements. Of note, followingthis arrangement the user marking cells are not restricted to beingeither on a uniform nor a rectangular grid arrangement, but they canappear in any desired location that artistic taste desires (in oneexample, the user marking cells may need to be separated by a minimumpredetermined distance).

Any user marking cells that are not detected (e.g., due to adverseillumination conditions) may have their displacement vectors estimatedby interpolating the displacement vectors of their neighbors. As aresult, the positions of all user marking cells on the image of theform, as it is captured by the image sensor, may be either estimated ifthe user marking cell itself is not detected, or discovered by detectionof the cell boundary.

The system may then proceed to extract any possible user marks fromareas of the image around the previously determined user marking cellcenters. As non-planar distortions can cause self-shadowing and ambientillumination can cause other shadows, disturbing the user mark detectionprocess, it may be important to attenuate their effect prior to findingcandidate image pixels that indicate the presence of a user mark. Thismay be done, for example, by estimating a two-dimensional lineargradient of the luminosity based on the pixels outside the visible usermarking cell boundaries. The usage of these pixels may be beneficial,since it is typically rare for a user mark to extend out of the usercell boundaries.

The linear gradient may then be compensated around the image regionaround the user marking cell center. The existence of user marks maythen substantiated by examining the processed information inside eachcell.

Table 1, below, provides additional detail regarding adetection/determination method (e.g., a computer implemented algorithm)according to an embodiment of the present invention.

TABLE 1 1. Image binarization for printed marks 2. Valid fiducial & IDstripe combination? If no, discard. If yes proceed to 3 3. Horizontal &vertical filtering and binarization for detection of the boundary of theuser marking cells 4. Morphological processing for the extraction of thecenters of the detected user marking cells 5. For every 5.a. Projectfrom image plane onto form coordinate detected user cell system usingintrinsic camera parameters 5.b. Displace detected center according todisplacement of already associated neighbors 5.c. Attempt associationwith a planar position of the user marking cells. If no, discard. If yesproceed to 5.d. 5.d. Estimate displacement vector 5.e. Loop to 5.a. 6.For every non- 6.a. Estimate displacement vector by interpolatingassociated planar vectors of associated neighbors position 6.b. Projectdisplaced ideal cell center onto image 6.c. Loop to 6.a. 7. For everyuser 7.a. Estimate local white level using empty area marking cellbetween user marking cell boundaries center on image 7.b. Binarize theinterior of user marking cell using local white level estimate 7.c.Gather active pixels to form evidence of user mark in cell 7.d. Declareexistence of user mark if evidence exceeds a predetermined amount 7.e.Loop to 7.a.

Referring now to FIGS. 13A and 13B, a flowchart providing additionaldetail regarding a detection/determination method (e.g., a computerimplemented algorithm) according to the embodiment of Table 1 is shown.More particularly, as seen in FIG. 13A this method may begin with thecapture of an image (e.g., by an image sensor). Further, as seen in FIG.13B this method may end with a report of user marks (e.g., a report indigital form to a computer, printer and/or other device such that alottery ticket evidencing the user's selection(s) may be output, suchthat survey results(s) may be output, or such that testresult(s)/score(s) may be output).

In another embodiment, a method for detecting user marks is provided,comprising: placing a form (see, e.g., form 400 of FIGS. 4 and 6 andform 700A of FIG. 7) in a field of view of a camera (see, e.g., system101 of FIG. 1, which may include a camera), wherein the form includesthereon at least a first fiducial mark (see, e.g., fiducial marks 401Aand 401B of form 400 of FIGS. 4 and 6 and fiducial marks 701A and 701Bof form 700A of FIG. 7) and a second fiducial mark (see, e.g., fiducialmarks 401A and 401B of form 400 of FIGS. 4 and 6 and fiducial marks 701Aand 701B of form 700A of FIG. 7), and wherein each of the first fiducialmark and the second fiducial mark has a measurable property that isessentially scale invariant; utilizing the camera to generate anelectronic image of at least a portion of the form; calculating with aprocessor mechanism (see, e.g., system 101 of FIG. 1, which may includea processor mechanism) in operative communication with the camera, basedat least in part upon the electronic image, a distance between at leastthe first fiducial mark and the second fiducial mark; detecting with theprocessor mechanism at least a first user marking cell on the form,wherein the first user marking cell is bounded by at least one indiciumthat is visible to the camera (see, e.g., user marking cells of form 400in FIGS. 4 and 6, user marking cells of form 700A of FIG. 7, usermarking cells of form 800 of FIG. 8 and user marking cells of form 1000Aof FIG. 10), and wherein the first user marking cell is detected basedat least in part upon the calculated distance between the first fiducialmark and the second fiducial mark; calculating with the processormechanism a displacement vector of the detected first user marking cellversus an ideal planar position of the detected first user marking cell;detecting with the processor mechanism at least a second user markingcell on the form, wherein the second user marking cell is bounded by atleast one indicium that is visible to the camera (see, e.g., usermarking cells of form 400 in FIGS. 4 and 6, user marking cells of form700A of FIG. 7, user marking cells of form 800 of FIG. 8 and usermarking cells of form 1000A of FIG. 10), and wherein the second usermarking cell is detected based at least in part upon the displacementvector of the detected first user marking cell; determining with theprocessor mechanism evidence of at least a first user mark in thedetected first user marking cell based at least in part upon a degree ofbrightness similarity between: (a) at least a portion of the electronicimage surrounding the indicium bounding the first user marking cell; and(b) at least a portion of the electronic image included inside theindicium bounding the first user marking cell; and determining with theprocessor mechanism evidence of at least a second user mark in thedetected second user marking cell based at least in part upon a degreeof brightness similarity between: (a) at least a portion of theelectronic image surrounding the indicium bounding the second usermarking cell; and (b) at least a portion of the electronic imageincluded inside the indicium bounding the second user marking cell.

In one example, the method may further comprise: calculating with theprocessor mechanism a displacement vector of the detected second usermarking cell versus an ideal planar position of the detected second usermarking cell; and detecting with the processor mechanism at least athird user marking cell on the form, wherein the third user marking cellis bounded by at least one indicium that is visible to the camera (see,e.g., user marking cells of form 400 in FIGS. 4 and 6, user markingcells of form 700A of FIG. 7, user marking cells of form 800 of FIG. 8and user marking cells of form 1000A of FIG. 10), and wherein the thirduser marking cell is detected based at least in part upon at least oneof: (a) the displacement vector of the detected first user marking cell;and (b) the displacement vector of the detected second user markingcell.

In another example, the method may further comprise: determining withthe processor mechanism evidence of at least a third user mark in thedetected third user marking cell based at least in part upon a degree ofbrightness similarity between: (a) at least a portion of the electronicimage surrounding the indicium bounding the third user marking cell; and(b) at least a portion of the electronic image included inside theindicium bounding the third user marking cell.

In another example, the third user marking cell may be detected based atleast in part upon at least both of: (a) the displacement vector of thedetected first user marking cell; and (b) the displacement vector of thedetected second user marking cell.

In another example, the third user marking cell may be detected based atleast in part upon interpolation between: (a) the displacement vector ofthe detected first user marking cell; and (b) the displacement vector ofthe detected second user marking cell.

In another example, the method may further comprise: detecting with theprocessor mechanism at least a third user marking cell on the form,wherein the third user marking cell is bounded by an indicium that isvisible to the camera (see, e.g., user marking cells of form 400 inFIGS. 4 and 6, user marking cells of form 700A of FIG. 7, user markingcells of form 800 of FIG. 8 and user marking cells of form 1000A of FIG.10), and wherein the third user marking cell is detected based at leastin part upon at least one of: (a) a position of the detected first usermarking cell; and (b) a position of the detected second user markingcell.

In another example, the method may further comprise: determining withthe processor mechanism evidence of at least a third user mark in thedetected third user marking cell based at least in part upon a degree ofbrightness similarity between: (a) at least a portion of the electronicimage surrounding the indicium bounding the third user marking cell; and(b) at least a portion of the electronic image included inside theindicium bounding the third user marking cell.

In another example, the third user marking cell may be detected based atleast in part upon at least both of: (a) the position of the detectedfirst user marking cell; and (b) the position of the detected seconduser marking cell.

In another example, the third user marking cell may be detected based atleast in part upon interpolation between: (a) the position of thedetected first user marking cell; and (b) the position of the detectedsecond user marking cell.

In another example, the method may further comprise determining with theprocessor mechanism when the form becomes essentially stationary afterbeing placed in the field of view of the camera.

In another example, the method may further comprise decoding with theprocessor mechanism identification information on the form.

In another example, at least a first indicium bounding the first usermarking cell may form a closed boundary and at least a second indiciumbounding the second user marking cell may form a closed boundary.

In another example, each indicium bounding each user marking cell may beprinted in ink.

In another example, each indicium may be visible to both the camera anda human.

In another example, the processor mechanism may comprise a singleprocessor (see, e.g., system 101 of FIG. 1, which may include a singleprocessor).

In another example, the processor mechanism may comprise a plurality ofprocessors (see, e.g., system 101 of FIG. 1, which may include aplurality of processors).

In another example, the form may be selected from the group consistingof: a lottery play slip; a survey; and a test.

In another example, the camera may comprise at least one image sensor(see, e.g., system 101 of FIG. 1, which may include at least one imagesensor).

In another example, the camera may comprise at least one lens (see,e.g., system 101 of FIG. 1, which may include at least one lens).

In another example, the user marking cells may be laid out in a gridpattern, with essentially uniform spacing between adjacent user markingcells in at least one of a horizontal direction and a verticaldirection.

In another example, the user marking cells may be laid out in a gridpattern, with essentially uniform spacing between adjacent user markingcells in both a horizontal direction and a vertical direction.

In another example, the user marking cells may be laid out in a non-gridpattern.

In another example, the method may further comprise at least oneindicium inside at least one user marking cell (see, e.g., user markingcells of form 400 in FIGS. 4 and 6, user marking cells of form 700A ofFIG. 7, user marking cells of form 800 of FIG. 8 and user marking cellsof form 1000A of FIG. 10).

In another example, the indicium inside the user marking cell maycomprise at least one of a number and a letter, printed in ink invisibleto the camera and visible to humans (see, e.g., user marking cells ofform 400 in FIGS. 4 and 6, user marking cells of form 700A of FIG. 7,user marking cells of form 800 of FIG. 8 and user marking cells of form1000A of FIG. 10).

In another example, the steps may be carried out in the order recited.

In another embodiment, a system for detecting user marks is provided,comprising: a camera (see, e.g., system 101 of FIG. 1, which may includea camera); a processor mechanism (see, e.g., system 101 of FIG. 1, whichmay include a processor mechanism) in operative communication with thecamera; and at least one form (see, e.g., form 400 of FIGS. 4 and 6 andform 700A of FIG. 7), wherein the form includes thereon at least a firstfiducial mark and a second fiducial mark (see, e.g., fiducial marks 401Aand 401B of form 400 of FIGS. 4 and 6 and fiducial marks 701A and 701Bof form 700A of FIG. 7), and wherein each of the first fiducial mark andthe second fiducial mark has a measurable property that is essentiallyscale invariant; wherein, when the form is placed in a field of view ofthe camera, the camera and the processor mechanism operate to carry outthe following steps: generating, with the camera, an electronic image ofat least a portion of the form; calculating with the processormechanism, based at least in part upon the electronic image, a distancebetween at least the first fiducial mark and the second fiducial mark;detecting with the processor mechanism at least a first user markingcell on the form, wherein the first user marking cell is bounded by atleast one indicium that is visible to the camera (see, e.g., usermarking cells of form 400 in FIGS. 4 and 6, user marking cells of form700A of FIG. 7, user marking cells of form 800 of FIG. 8 and usermarking cells of form 1000A of FIG. 10), and wherein the first usermarking cell is detected based at least in part upon the calculateddistance between the first fiducial mark and the second fiducial mark;calculating with the processor mechanism a displacement vector of thedetected first user marking cell versus an ideal planar position of thedetected first user marking cell; detecting with the processor mechanismat least a second user marking cell on the form, wherein the second usermarking cell is bounded by at least one indicium that is visible to thecamera (see, e.g., user marking cells of form 400 in FIGS. 4 and 6, usermarking cells of form 700A of FIG. 7, user marking cells of form 800 ofFIG. 8 and user marking cells of form 1000A of FIG. 10), and wherein thesecond user marking cell is detected based at least in part upon thedisplacement vector of the detected first user marking cell; determiningwith the processor mechanism evidence of at least a first user mark inthe detected first user marking cell based at least in part upon adegree of brightness similarity between: (a) at least a portion of theelectronic image surrounding the indicium bounding the first usermarking cell; and (b) at least a portion of the electronic imageincluded inside the indicium bounding the first user marking cell; anddetermining with the processor mechanism evidence of at least a seconduser mark in the detected second user marking cell based at least inpart upon a degree of brightness similarity between: (a) at least aportion of the electronic image surrounding the indicium bounding thesecond user marking cell; and (b) at least a portion of the electronicimage included inside the indicium bounding the second user markingcell.

In one example, the camera may comprise at least one image sensor (see,e.g., system 101 of FIG. 1, which may include at least one imagesensor).

In another example, the camera may comprise at least one lens (see,e.g., system 101 of FIG. 1, which may include at least one lens).

In another example, the processor mechanism may comprise a singleprocessor (see, e.g., system 101 of FIG. 1, which may include a singleprocessor).

In another example, the processor mechanism may comprise a plurality ofprocessors (see, e.g., system 101 of FIG. 1, which may include aplurality of processors).

In another example, the steps carried out by the camera and theprocessor mechanism may be carried out in the order recited.

In another example, the system may further comprise calculating, withthe processor mechanism, the presence of an immobile form.

In another example, each of one or more fiducial marks may appear asessentially scale invariant to an algorithm (e.g., an algorithmprocessed by a processor mechanism).

In another example, each of one or more fiducial marks may have ameasurable property that is essentially scale invariant (e.g.,essentially scale invariant to an algorithm processed by a processormechanism).

In another example, a brightness similarity described herein may relateto a white level (e.g., a local white level).

In another example, an intensity similarity may be utilized in a mannerakin to the brightness similarity described herein.

In another example, a luminosity similarity may be utilized in a mannerakin to the brightness similarity described herein.

For the purposes of this disclosure, a computer readable medium is amedium that stores computer data/instructions in machine readable form.By way of example, and not limitation, a computer readable medium cancomprise computer storage media as well as communication media, methodsand/or signals. Computer storage media includes volatile and/ornon-volatile, removable and/or non-removable media implemented in anymethod and/or technology for storage of information such ascomputer-readable instructions, data structures, program modules and/orother data. Computer storage media includes, but is not limited to, RAM,ROM, EPROM, EEPROM, flash memory and/or other solid state memorytechnology; CD-ROM, DVD, and/or other optical storage; cassettes, tape,disk, and/or other magnetic storage devices; and/or any other mediumwhich can be used to tangibly store the desired information and whichcan be accessed by the computer.

Further, the present invention may, of course, be implemented using anyappropriate computer readable medium, computer hardware and/or computersoftware. In this regard, those of ordinary skill in the art are wellversed in the type of computer hardware that may be used (e.g., one ormore mainframes, one or more server computers, one or more clientcomputers, one or more mini-computers, one ore more personal computers(“PC”), one or more networks (e.g., an intranet and/or the Internet)),the type of computer programming techniques that may be used (e.g.,object oriented programming), and the type of computer programminglanguages that may be used (e.g., C++, Basic). The aforementionedexamples are, of course, illustrative and not restrictive.

Of course, any embodiment/example described herein (or any feature orfeatures of any embodiment/example described herein) may be combinedwith any other embodiment/example described herein (or any feature orfeatures of any such other embodiment/example described herein).

While a number of embodiments/examples of the present invention havebeen described, it is understood that these embodiments/examples areillustrative only, and not restrictive, and that many modifications maybecome apparent to those of ordinary skill in the art. For example,certain methods may be “computer implementable” or “computerimplemented.” To the extent that such methods are implemented using acomputer, not every step must necessarily be implemented using acomputer. Further, fiducial marks of various embodiments may be of anydesired, hollow shape. Further still, fiducial marks of variousembodiments may be particularly useful when more than one type of formmay be detected and/or there is a stack of multiple forms (wherein, forexample, all of the forms in the stack are not aligned). Further still,user marking cells may be of any desired shape and may be arranged inany desired pattern. Further still, the forms of the present inventionmay utilize any conventional features (e.g., clocks), as desired.Further still, fiducial marks and/or user marking cells may be printedor otherwise placed on the forms. Further still, the various steps maybe carried out in any desired order (and any desired steps may be addedand/or any desired steps may be eliminated).

What is claimed is:
 1. A method for detecting user marks, comprising:placing a form in a field of view of a camera, wherein the form includesthereon at least a first fiducial mark and a second fiducial mark;wherein the first fiducial mark comprises an outline portion and aninterior portion; distinguishing, by the camera, the outline portion ofthe first fiducial mark from the interior portion of the first fiducialmark based at least in part on the outline portion of the first fiducialmark being sufficiently different from the interior portion of the firstfiducial mark; calculating a scale and orientation of the first fiducialmark based at least in part on: 1) the ratio of an area of the outlineportion of the first fiducial mark and an interior area of the interiorportion of the first fiducial mark, and 2) a first distance between thecamera and the first fiducial mark; wherein the second fiducial markcomprises an outline portion and an interior portion; distinguishing, bythe camera, the outline portion of the second fiducial mark from theinterior portion of the second fiducial mark based at least in part onthe outline portion of the second fiducial mark being sufficientlydifferent from the interior portion of the second fiducial mark; andcalculating a scale and orientation of the second fiducial mark based atleast in part on: 1) the ratio of an area of the outline portion of thesecond fiducial mark and an interior area of the interior portion of thesecond fiducial mark and 2) a second distance between the camera and thesecond fiducial mark; calculating a distance between at least the firstfiducial mark and the second fiducial mark with a processor mechanism inoperative communication with the camera, based at least in part upon: 1)the scale and the orientation of the first fiducial mark, and 2) thescale and the orientation of the second fiducial mark; detecting withthe processor mechanism at least a first user marking cell on the formbased at least in part upon the calculated distance between the firstfiducial mark and the second fiducial mark, wherein the first usermarking cell is bounded by at least one first indicium that is visibleto the camera; calculating with the processor mechanism a displacementvector of the detected first user marking cell versus an ideal planarposition of the detected first user marking cell; detecting with theprocessor mechanism at least a second user marking cell on the form,wherein the second user marking cell is bounded by at least one secondindicium that is visible to the camera, and wherein the second usermarking cell is detected based at least in part upon the displacementvector of the detected first user marking cell; determining with theprocessor mechanism evidence of at least a first user mark in thedetected first user marking cell based at least in part upon a degree ofbrightness similarity between: (a) at least a portion of the electronicimage surrounding the at least one first indicium bounding the firstuser marking cell; and (b) at least a portion of the electronic imageincluded inside the at least one first indicium bounding the first usermarking cell; and determining with the processor mechanism evidence ofat least a second user mark in the detected second user marking cellbased at least in part upon a degree of brightness similarity between:(a) at least a portion of the electronic image surrounding the at leastone second indicium bounding the second user marking cell; and (b) atleast a portion of the electronic image included inside the at least onesecond indicium bounding the second user marking cell.
 2. The method ofclaim 1, further comprising: calculating with the processor mechanism adisplacement vector of the detected second user marking cell versus anideal planar position of the detected second user marking cell; anddetecting with the processor mechanism at least a third user markingcell on the form, wherein the third user marking cell is bounded by atleast one third indicium that is visible to the camera, and wherein thethird user marking cell is detected based at least in part upon at leastone of: (a) the displacement vector of the detected first user markingcell; and (b) the displacement vector of the detected second usermarking cell.
 3. The method of claim 2, further comprising: determiningwith the processor mechanism evidence of at least a third user mark inthe detected third user marking cell based at least in part upon adegree of brightness similarity between: (a) at least a portion of theelectronic image surrounding the at least one third indicium boundingthe third user marking cell; and (b) at least a portion of theelectronic image included inside the at least one third indiciumbounding the third user marking cell.
 4. The method of claim 2, whereinthe third user marking cell is detected based at least in part upon: (a)the displacement vector of the detected first user marking cell; and/or(b) the displacement vector of the detected second user marking cell. 5.The method of claim 2, wherein the third user marking cell is detectedbased at least in part upon interpolation between: (a) the displacementvector of the detected first user marking cell; and (b) the displacementvector of the detected second user marking cell.
 6. The method of claim1, further comprising: detecting with the processor mechanism at least athird user marking cell on the form, wherein the third user marking cellis bounded by at least one third indicium that is visible to the camera,and wherein the third user marking cell is detected based at least inpart upon at least one of: (a) a position of the detected first usermarking cell; and (b) a position of the detected second user markingcell.
 7. The method of claim 6, further comprising: determining with theprocessor mechanism evidence of at least a third user mark in thedetected third user marking cell based at least in part upon a degree ofbrightness similarity between: (a) at least a portion of the electronicimage surrounding the at least one third indicium bounding the thirduser marking cell; and (b) at least a portion of the electronic imageincluded inside the at least one third indicium bounding the third usermarking cell.
 8. The method of claim 6, wherein the third user markingcell is detected based at least in part upon: (a) the position of thedetected first user marking cell; and/or (b) the position of thedetected second user marking cell.
 9. The method of claim 6, wherein thethird user marking cell is detected based at least in part uponinterpolation between: (a) the position of the detected first usermarking cell; and (b) the position of the detected second user markingcell.
 10. The method of claim 1, further comprising determining with theprocessor mechanism when the form becomes essentially stationary afterbeing placed in the field of view of the camera.
 11. The method of claim1, further comprising decoding with the processor mechanismidentification information on the form.
 12. The method of claim 1,wherein the at least one first indicium bounding the first user markingcell forms a closed boundary and the at least one second indiciumbounding the second user marking cell forms a closed boundary.
 13. Themethod of claim 1, wherein each indicium bounding each user marking cellis printed in ink.
 14. The method of claim 1, wherein each indicium isvisible to both the camera and a human.
 15. The method of claim 1,wherein the processor mechanism comprises a single processor.
 16. Themethod of claim 1, wherein the processor mechanism comprises a pluralityof processors.
 17. The method of claim 1, wherein the form is selectedfrom the group consisting of: a lottery play slip; a survey; and a test.18. The method of claim 1, wherein the camera comprises at least oneimage sensor.
 19. The method of claim 18, wherein the camera comprisesat least one lens.
 20. The method of claim 1, wherein the user markingcells are laid out in a grid pattern, with essentially uniform spacingbetween adjacent user marking cells in at least one of a horizontaldirection and a vertical direction.
 21. The method of claim 20, whereinthe user marking cells are laid out in a grid pattern, with essentiallyuniform spacing between adjacent user marking cells in both a horizontaldirection and a vertical direction.
 22. The method of claim 1, whereinthe user marking cells are laid out in a non-grid pattern.
 23. Themethod of claim 1, wherein the at least one first indicium is inside theat least one first user marking cell and the at least one secondindicium is inside the at least one second user marking cell and whereinthe at least one first indicium is inside the at least one first usermarking cell or the at least one second indicium is inside the at leastone second user marking cell.
 24. The method of claim 23, wherein the atleast one first indicium and the at least one second indicium compriseat least one of a number and a letter, printed in ink invisible to thecamera and visible to humans and wherein the at least one first indiciumor the at least one second indicium comprise at least one of a numberand a letter, printed in ink invisible to the camera and visible tohumans.
 25. The method of claim 1, wherein each step is carried out inthe order recited.
 26. The method of claim 1, wherein the form isnon-planar.
 27. A system for detecting user marks, comprising: a camera;a processor mechanism in operative communication with the camera; and atleast one form, wherein the form includes thereon at least a firstfiducial mark and a second fiducial mark; wherein the first fiducialmark comprises an outline portion and an interior portion; wherein theoutline portion of the first fiducial mark is sufficiently differentfrom the interior portion of the first fiducial mark so as to result inthe camera being capable of distinguishing between the outline portionand the interior portion; wherein the second fiducial mark comprises anoutline portion and an interior portion; wherein the outline portion ofthe second fiducial mark is sufficiently different from the interiorportion of the second fiducial mark so as to result in the camera beingcapable of distinguishing between the outline portion and the interiorportion; and wherein, when the form is placed in a field of view of thecamera, the camera and the processor mechanism are adapted to carry outthe following steps: calculating a scale and orientation of the firstfiducial mark based at least in part on: 1) the ratio of an area of theoutline portion of the first fiducial mark and an interior area of theinterior portion of the first fiducial mark and 2) a first distancebetween the camera and the first fiducial mark; calculating a scale andorientation of the second fiducial mark based at least in part on 1) theratio of an area of the outline portion of the second fiducial mark andan interior area of the interior portion of the second fiducial mark and2) a second distance between the camera and the second fiducial mark;calculating a distance between at least the first fiducial mark and thesecond fiducial mark with the processor mechanism in operativecommunication with the camera, based at least in part upon: 1) the scaleand the orientation of the first fiducial mark, and 2) the scale and theorientation of the second fiducial mark; detecting with the processormechanism at least a first user marking cell on the form based at leastin part upon the calculated distance between the first fiducial mark andthe second fiducial mark, wherein the first user marking cell is boundedby at least one first indicium that is visible to the camera;calculating with the processor mechanism a displacement vector of thedetected first user marking cell versus an ideal planar position of thedetected first user marking cell; detecting with the processor mechanismat least a second user marking cell on the form, wherein the second usermarking cell is bounded by at least one second indicium that is visibleto the camera, and wherein the second user marking cell is detectedbased at least in part upon the displacement vector of the detectedfirst user marking cell; determining with the processor mechanismevidence of at least a first user mark in the detected first usermarking cell based at least in part upon a degree of brightnesssimilarity between: (a) at least a portion of the electronic imagesurrounding the at least one first indicium bounding the first usermarking cell; and (b) at least a portion of the electronic imageincluded inside the at least one first indicium bounding the first usermarking cell; and determining with the processor mechanism evidence ofat least a second user mark in the detected second user marking cellbased at least in part upon a degree of brightness similarity between:(a) at least a portion of the electronic image surrounding the at leastone second indicium bounding the second user marking cell; and (b) atleast a portion of the electronic image included inside the at least onesecond indicium bounding the second user marking cell.
 28. The system ofclaim 27, wherein the camera comprises at least one image sensor. 29.The system of claim 27, wherein the camera comprises at least one lens.30. The system of claim 27, wherein the processor mechanism comprises asingle processor.
 31. The system of claim 27, wherein the processormechanism comprises a plurality of processors.
 32. The system of claim27, wherein the steps carried out by the camera and the processormechanism are carried out in the order recited.
 33. The system of claim27, further comprising calculating, with the processor mechanism, thepresence of an immobile form.
 34. The system of claim 27, wherein theform is non-planer.